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Abstract 

We study the spectral aspects of the graph limit theory. We give a description of graphon con- 
vergence in terms of converegnce of eigenvalues and eigenspaces. Along these lines we prove a 
spectral version of the strong regularity lemma. Using spectral methods we investigate group ac- 
tions on graphons. As an application we show that the set of isometry invariant graphons on the 
sphere is closed in terms of graph convergence however the analogous statement does not hold for 
the circle. This fact is rooted in the representation theory of the orthogonal group. 
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1 Introduction 

The so called graph limit theory (see Il7l,|[l0l,ll21,|l2l,|[ll],|[l2l,|[l3l,|[l41) is a type of calculus devel- 
oped on the completion of the set of finite graphs. As it was proved in IfTOl . the elements of the 
completion can be represented by two variable symmetric functions W : [0, 1]^ [0, 1]. It is very 
natural to interpret such functions as self adjoint integral kernel operators on L2{[0, 1]). Classical 
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theory says that every such operator has a spectral decomposition converging in L2- In this paper 
we focus on the spectral aspects of the graph limit theory. In the course of this investigation various 
interesting topics come up. 

It was proved in ifTTl that the graph Umit space is compact in the topology generated by a distance 
(called (5n) derived from the well known cut norm. This compactness implies a strong form [9] of 
Szemeredi's regularity lemma |15|. We give a new interpretation of cut norm convergence and 
5\2 convergence in terms of spectral decompositions. Roughly speaking we prove that a sequence 
is convergent if and only if the eigenvalue sequences and the eigenspace structures converge in a 
rather strong way. 

As a consequence we obtain a spectral form of the strong regularity lemma which can be re- 
garded as a generalization of the strong regularity lemma by Alon, Fischer, Krivelevich and Szegedy 
||9l . We mention that numerous spectral aspects of the regularity lemma were studied by several au- 
thors. The closest approach to ours is by Frieze and Kannan fS). An advantage of this type of 
regularization is that it is invariant under the symmetry group of the graph or graphon. 

Using this fact we show that graphons or graphs can be regularized in a way that the structured 
part, which is a step function with bounded number of steps, is approximatively invariant under 
every automorphism of the graphon or graph. We call this statement the "symmetry preserving 
regularity lemma". A symmetry preserving removal lemma was proved in lfT6l 

If a unitary group action G on L2([0, 1]) stabilizes a given graphon then the eigenspaces are 
also invariant under G. In particular they define finite dimensional representations of G. This 
creates an interesting connection between regularization and representation theory. In ||6| Gowers 
proved that if in a finite group the dimension of the minimal non trivial irreducible representation is 
sufficiently big then its Cayley graphs are all arbitrarily quasi random. It is not hard to generalize 
this result for graphons with unitary group actions (see corollarv ll.3l ). In the infinite case however 
a new interesting phenomenon appears. Let (V, ji) be a probability space. If a unitary action of 
G on L2{V, fi) satisfies the condition that for every k there is a finite dimensional subspace of 
L2{V, /i) containing all the G invariant subspaces of dimension at most k then we say the G acts 
weakly random. It turns out that graphons invariant under a weakly random action behave in a 
more controlled way. For example we prove that they form a closed set in the cut norm and so in 
the 60 distance. In particular the set of such graphons has a graph theoretic characterization using 
inequalities in subgraph densities. 

Quite surprisingly, the circle behaves very different from the higher dimensional spheres. The 
set of isometry invariant graphons on the spheres of dimension > 2 is closed in the (J^-norm and 
so it has a "graph theoretic characterization". On the other hand isometry invariant graphons on the 
circle can have limits which can only be defined on the torus (or some other compact abelian group). 
This fundamental difference is coming from the fact that the action of On+i on L2{Sn) is weakly 
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random if and only if n > 3. 

1.1 Hilbert- Schmidt kernel operators 

Let us fix a separable probability space (V, /i). Let H denote the complex Hilbert space L2{V, ji) 
with scalar product (/, g) ~ My{f{v)g{v)). The elements ofH are measurable functions so it makes 
sense to talk about their L^o (or Li) norms even though the Loo norm might be infinite. 

Recall that a sequence {fi}°Zi is called weakly convergent if {{fi,g)}^i is convergent for ev- 
ery g E H. It follows from the principle of uniform boundedness that weakly convergent sequences 
are bounded. Every weakly convergent sequence has a limit in H. It is easy to see that every 
bounded sequence has a weakly convergent subsequence. It is known that convex bounded closed 
sets are weakly compact. For example the closed unit ball in the Loo norm is weakly compact. 

Lemma 1.1 Let {fi} be a weakly convergent sequence in H with limit f such that liuii^oo H/ilh = 
II/II2 then converges to f in the L2 norm. 

Proof. We have lim.^oo \\h - /II2 = lim,^oo(/- /^, /-/.)= lim.^oo II/II2 + II/.II2 - (/, /^) - 
(/^,/) = 0. 

A function Af : F x F — ^ C is called a Hilbert- Schmidt kernel operator if Af g L2{V 'xV^v'xv). 
This is equivalent with saying that M S H The operator A/ acts on H by / 1— > Mf where 

Mf{x) — E,y{M{x, y)f{y))- The image space ran(Af ) of M is the Hilbert space generated by the 
functions {Mf\f e V.}. 

We will use the notion of weak convergence of kernel operators. A sequence of Hilbert- Schmidt 
kernel operators {Hi}"^^ is called weakly convergent if they are weakly convergent in the Hilbert 
space H (E)H* — L2{V x V). It is easy to see that if {||iJi||2}^i is a bounded sequence then 
{Hi}°^i is weakly convergent if and only if the sequences {g* Hif}°^i are convergent for every 
pair f,ge L2{V). 

An important consequence of the Cauchy-Schwartz inequality is that 

||M.9||2< ||M||2||g||2 and |rAfg| < ||/||2 ||g||2 ||Af|l2 (1) 
for every f,gEH and M E H ^H*. We will need the next lemma. 

Lemma 1.2 Let be a weakly convergent sequence in % with limit f. If M E "H® %* then 

lim=^i||A//,-A//||2 = 0. 

Proof. We have that ||/i||2 < c for every i with some positive constant c. Let be an ortho- 

normal basis mT-L. Then A/ = J2i j '^^ere ^ lo^i.jP — H-^^lb- For every e > there is 

a number t such that Mt = J2i<i j<t '^i-jK^j satisfies \\M — Mt\\2 < £■ We have that by ([T]i that 

\\Mf, - Mf\\2 = \\{M - Mt)fr + {M - Mt)f + Mtfr - Mtfh < 2ec+\\Mtf^ - Mtfh- 
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If i is big enough then 

t t 2 

\\Mtfi - Mjg = Y^l^^iAbjJi - /) 
i=i j=i 

is smaller than (ec)^ and for such indices ||M/, — Mf\\2 < Sec. Applying it for every e > the 
proof is complete. 

This implies immediately the next lemma. 

Lemma 1.3 Let {fi}iZi {fJi}iZi be two weakly convergent sequences in % with limits f and 
g. Let M bea Hilbert-Schmidt kernel operator Then lim f^Mgi = f*Mg. 

Let M G H iSi T-L* he a self adjoint Hilbert-Schmidt kernel operator. It is is well known that M 
has a spectral decomposition 

oo 

i=l 

where {,fi}^i is an orthogonal system of unit length elements in H and the number's e K satisfy 
X^i^i l-^iP = ll-^lh- The numbers {Ajj^i are the eigenvalues of M listed with multiphcities. 

Deiuiition 1.1 Let M : V x V ^ Cbe a self adjoint kernel operator with spectral decomposition 
M = J2i fifi^i ^i<^ A > 0. Then we denote by [M]\ the sum \\i\>\} fifi^i- 

It is easy to see that [M]x does not depend on the concrete choice of the functions fi even if there 
are multiple eigenvalues. A basis independent definition of [M]x is [M]x = tPt where Pr 

is the orthogonal projection to the eigenspace Wr = {f\Mf = r/}. 

Since M is a measurable function on V x V we can talk about the L^o and Li norms of M. 
Kernel operators with finite Loo norms will have a special importance for us. 

Lemma 1.4 Let M be a self adjoint kernel operatorwith ||M||oo < 1- Assume that f gH satisfies 
\\f\\2 = I and Mf = Xf for some nonzero number X. Then\\f\\oo < 

Proof ByCauchy-Schwartzwehavethat|A/(a;)| = |M/(x)| = \Ey{M{x,y)f{y))\ < ||/||2 = 1. 
The spectral radius is an important invariant of kernel operators. It is defined as 

rad(M)= sup ||M/||2. 

Il/I|2 = l 

The spectral radius of a self adjoint kernel operator is the maximum of the absolute values of its 
eigenvalues. 

1.2 The cut norm 

We wiU use the cut norm on H (Si Ti* defined by 

||M||n = sup \f*Mg\. 
ll/lloc,||slU<i 
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where / and g ranges over all possible measurable functions on V with L^o norm at most 1. Note 
that there are several definitions of the 1 1 . 1 1 □ -norm that equivalent up to constant constant multiples. 
For example in lITOll we used sup^ ^ \ Isxt where S, T runs through all pairs of measurable sets 
in V. 

Lemma 1.5 ||A/||q < spec(M). 

Proof. Let /, g be arbitrary functions with ||/||oo < 1 and ||.g||oo < 1- We have that ||/||2 < 1 and 
||g||2 < 1. Then ||A/g||2 < rad(Af) and so by Cauchy-Schwartz f*MG < rad(A/). 
This implies the next lemma. 

Lemma 1.6 If M : V x V C is a self adjoint Hilbert- Schmidt operator and a > then 

\\M-[MU\u<a. 

Lemma 1.7 If a bounded sequence of kernel operators {Mi\°°^-^ converges to M in the cut norm 
then it converges to M in the weak topology inH <Si H*. In particular if f, g £ H then limi^oo f* Mig 
PMg. 

Proof. Let S be the set of finite linear combinations of operators of the form fg* where f,gG 
Loo{V). It is classical that S is dense in the Hilbert space H (E) H*. The cut norm convergence 
implies that limi_,.oo(Q, Mi) = {Q, M) for every Q E S. Since {Mi}^^ is a bounded sequence it 
has to be weakly convergent with limit M. 

The previous lemma with lemma fTTI implies the next corollary. 

Corollary 1.1 If a sequence {Mi} in % ® %* converges to M in the cut norm and limi_j.oo |1 Afi |1 2 = 
||Af||2 then {Mi}^-^ converges to M in L2. 

LetT/) : V -> F be a measure preserving map. This means that ■)/' is measurable and — 
for every measurable subset ACl/. IfVF:Fxl/— >Cisa kernel operator then we define 

M^V' by W'l'{x,y) = W{il){x),^{y)). 

Let 1 1 . 1 1 „ be one of the norms 1 1 . 1 1 1 , 1 1 . 1 1 2 , | ] . 1 1 □ on "H (g) H * . We define the distance 5„ ( VFi , M^2 ) 
onU^H* by 

inf \\Wt^-Wt%. 

where ipi and ?/'2 ranges over all possible measure preserving maps on V. 

It is easy to see (and was pointed out in several papers) that one of the maps (say -02) can be 
omitted and the other one can be assumed to be invertible. This means 

SniWi,W2) =M\\W^ -W2\\n 

where ■0 ranges through all invertible measure preserving maps. This fact together with lemma fTTTI 
implies the next lemma. 
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Lemma 1.8 Let {Mi\°°^i be a S\j-com'ergent sequence with limit M. //||Af||2 = limi_j.oo llAfiliz 
then {Mi}°^i converges to M also in 6i. 

Let A4 denote the set of self adjoint operators in H <8) H* with ioo norm at most 1. Let X be 
the space obtained form Ai by identifying operators that are S]j distance from each other. This 
way {X,S\j) becomes a metric space. The next theorem follows from the results in ifTTl : 

Theorem 1 The metric space {X,da) is compact. 

1.3 Graph limits 

Let Wo denote the set of symmetric measurable functions W : [0, 1]^ — ^ [0, 1]. If G = (V, E) is a 
finite simple graph on the vertex set [k] = {1, 2, . . . , fe} then the homomorphism density of G in 
is defined by 

t{G,W) ~ / Y[ W{xt,Xj) dxi dx2 ■ ■ ■ dxn 

where xi,X2, ■ ■ ■ ,Xk are in [0,1]. 

The elements of Wq are also called graphons. Two graphons are equivalent if their S]j distance 
is 0. Let Xq denote the set of equivalence classes of graphons. The set {Xo,5^) is a compact 
topological space. We call Xq the graph limit space. The theory of graph limits is basically the 
calculus on the graph limit space. 

A sequence {Wi},^]^ in Wo is ^n-convergent if and only if {t{G, Wi)}°^i is convergent for 
every simple graph G. Two graphons Wi, W2 are equivalent if t{G, Wi) ~ t{G, W2) for every 
simple graph G. This implies that homomorphism densities are well defined on the elements of X. 
Let Q be the set of finite simple graphs. 

Definition 1.2 A map p : ^Yo — > K k called a graph polynomial if there are finitely many graphs 
Gi, G2, . . . , G„ in Q and real numbers Ai, A2, . . . , A„ such that p{W) = X]"=i ^{Gi, W)\i for 
every W £ Xq. 

If G e a is the disjoint union of Gi and G2 then t{G, W) = t{Gi,W)t{G2,W) for every 
W E Xq. It follows that polynomials are closed under multiplications and so they are forming a 
commutative algebra (containing the constant functions) of 60 continuous functions on Xq. Let 
K{Xq) denote this algebra. The Stone- Weierstrass theorem implies that every continuous function 
on Xo can be approximated in L^o by some polynomial function in K{Xo). The next lemma shows 
that closed subsets of Xq can be characterized through inequalities in subgraph densities. 

Lemma 1.9 A set G C Aq is a closed subset of Xq then there is a countable set of graph polynomi- 
als {p^}°Zl such that G = n°Zi{W\p^{W) > 0}. 
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Proof. Let d{W) = inf{(5n(PF, W2)\W2 G C} be the distance function from C. Since d is a 
continuous function we can approximate it with arbitrary Loo precision by graph polynomials. Let 
p'^ be an 1/i approximation of d in K{Xo) and let pi — l/i — p'l- It is clear that is 
appropriate system of polynomials. 

1.4 Convergence in cut norm 

In this part we examine the relationship between spectral decompositions and convergence in cut 
norm. We use the notation from the previous chapter Let {Af;}^]^ be a sequence of self adjoint 
kernel operators in H with ||Afi||oo < 1 such that they converge in the cut norm. Let Af be the 
cut norm limit of \JS/li\°^^. Obviously M is a self adjoint kernel operator and satisfies || oo < 1. 
We will keep this notation for the rest of this chapter and we will prove statements on the properties 
of the sequence {A/j}^^. 

It is not hard to see that cut norm convergence implies the following type of convergence of 
the spectrums. If for a kernel operator W with spectrum \\i\XL\ we define the random variable 
Xiy^) that takes the value with probabihty Af(X]i Af)"^ then the /c-th moment of X{W) is 
equal to t(C4+fc, W)/t{Ci, W) where C„ is the cycle of length n. It follows that from ifTOl that 
{X {Mi)}°^^ converges to X{A'I) in the weak topology of probability distributions. The spectrum 
with multiplicities is fully decodable from X{W) and t{C4, W) and so at the level of spectrums the 
cut norm convergence is fully described. 

In the rest of the chapter we study joint convergence of the spectrum and the eigenspaces. 

Lemma 1.10 Let {fi}°Zi be a weakly convergent sequence in % with limit f such that \\fi\\2 = 1 
for every i and Mifi = fiXi where limi^oo A,; = A 7^ 0. Then {fi\°°^i converges in L2 to f and 



Proof. Note that lemma [L4l implies that 1 1 /» 1 1 00 < | Ai | ^ . By lemma [T3] we have that limi_>.oo Mfi = 
f*Mf. On the other hand 



Mf = A/. 



|/*(Af- M,)/,| < \X^\'^M - M,\\a 



and from A 7^ we get 



= lim I/; (A/ - A/,)/, I = lim \f*Mf, - A,| - 1/*^/ - A|. 



(2) 



Using ||/,||oo < |A,| 



we get 



lim |r(Af,- A/)/,| < lim ||/||oo|A,ri||Af - A/,||n = 0. 



(3) 



It follows by (O, lemma[r3]and by Q that 



lim X^ifji) = lim /*Af,/, - lim f*Mf, = f*Mf = A 
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and so limi^oo(/, ft) = 1- Since ||/i||2 = 1 and ||/||2 < 1 this is only possible if ||/||2 = 1 and so 
by lemma[TT|{/j:}i^i converges to / in L2. 

Now we need to show that Mf = A/. Let g be any element in T-L with {g, f) = 0. We have that 

g*M,f = g*M,{f - /,) + g* MJ, = g* Kh{f - /,) + \,{g, /,) < 

< II.9||2||MJ2||/-/.||2 + A,(5,/.). 

It impUes that Yivcu^ao 9*^Uf — 0- On the other hand by lemma fLTl lim,.^^ g*Mi f = g*Mf. It 
follows that M f is orthogonal to every function g which is orthogonal to /. It follows that / is an 
eigenvalue of M and by f*Mf = A and || / || 2 — 1 the proof is complete. 

Lemma 1.11 Let X > be a number such that { — A, A} n spec(7lf) = 0. Then 

1. lim,^oork([M,]A) =rk([Af]A), 

2. lim,^oo||[Af.]A-[M]A||2 = 0. 

Proof. Assume that Mi = X^jli fi^jfi ^^'^^ that {|Aij |}°^]^ is a decreasing sequence and the 
vectors {fi.j}xi j^o are forming an orthonormal system. To keep the sequences {Xi,j}°^i infinite 
we put an infinite number of O's at the end if Af j has finite rank. (If X^ j = then /j is an arbitrarily 
chosen function of unit length.) 

First of all we prove that there is a subsequence {AIi}i^s satisfying the condition of the lemma. 
By a standard argument we can choose a subsequence 5* such that {fi,j}ieS is weakly convergent 
for every fixed j and {Xi,j}i£s is convergent for every j. Let fj be the weak limit of {fi.j}i£S 
and Xj be the limit of {Xi,j}i^s- Obviously we have that J^jLi — 1 ™d {I'^jllj^i is a 

decreasing sequence. It follows that |Aj | < l/Vj. First of all note that if Xj ^ then by lemma 
ILIOI lim^^oo Wfi.j ^ /i 1 1 2 — 0. It follows that if A^ ^ and Xj^ ar both non-zero then {fj-^ , fj^ ) = 0. 
In other words Aj ^^o} is an orthonormal system of functions. Let 

{j I A, 7^0} 

First we claim that Af = M' . For every natural number t we have that || Af^ — A/'||q is at most 

t 00 00 

\\Y.{k3fh^^,, - fjf;>^i) lb + II E k^fhK3\\u + II E /.//^^ib- 

J = l 3 = t + l j=t+l 

The spectral radius of the sums in the last two terms is at most 1 / VT+T. It follows that if i is big 
enough then \\Mi — A'/'||n < i/^/t + 1. By letting t go to infinity we get that Mi converges to Af 
in the cut norm and so Af ' = M. 

Let t be an integer greater than A~^. We have that \Xi,j\ < X whenever j > t. Since A, —A 
are not eigenvalues of M we have that there is an index ig such that for \Xij — Xj\ < |A — |Aj||/2 
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whenever I < j < t and i > ia , i E S. This means that for such indices |{j||Aij| > |A|}| = 
|{j|Aj > |A|}| = Tki[M]x) showing that rk([M,]A) = rk([A/]A). 

Now we finish the general case by contradiction. If the first statement is not true then we can 
choose an infinite subsequence where rk{[AIi]\) ^ [M]\. This is a contradiction sice from such a 
subsequence we can not choose a sub sequence satisfying the first condition. If the second condition 
fails then we can choose an infinite subsequence for some e such that || [MJa — [A^]a||2 > £• This 
is again a contradiction 

1.5 Spectral Regularity lemma 

Theorem 2 (Spectral regularity lemma) For an arbitrarily decreasing function F : R+ x M+ 

and every e > there is a constant (5 > such that for every self adjoint kernel operator 
M : V X V ^ with || Af ||oc < 1 on a separable probability space (V, /i) there is a real number 
\> 5 such that M has a decomposition AI = S + E + R with the following properties 

1. S= [M]a 

2. ||£;||2<e 

3. ||i?|b <F(A,e) 

4. ||^ + £;||oo < 1 

5. E and R are self adjoint. 

Proof. We go by contradiction. Let e > be a real number such that the theorem fails for e. This 
means that there is a sequence of kernel operators {Mi}"^^ with Loo norm at most 1 such that 
does not have the desired decomposition for 6 — We can assume without loss of generality 
that all the operators A/, are defined on the same standard probability space V. Also without loss 
of generality (by choosing a subsequence guaranteed by theoremlT]! we can assume that {Mi}°^^ is 
convergent in and so there is a sequence of invertible measure preserving maps '^^ ^ 

such that {Mf"^}"^^ converges to M with ||Af ||oo < 1 in the cut norm. Let A > be a number such 
that {A, -A} n specM = and || [M]x - M\\2 < e/3. By lemma lL 11] there is an index io such that 
fori > io we have || [A//']a - [A/] a||2 < e/3. This means that if i > io the || Af- [Af/']A||2 < 2e/3. 
Let E, = M - [Mf']x and R, = Mp - M. Now Af/' = [Aff']A + E, + R,. Now since Ri 
converges to in the cut norm it follows that there is an index ii > max(io , 1/A) such that if i > ii 
then ||f?,;||n < f^(A, e) satisfies the theorem with Applying t/;^^ to the decomposition of Af/'' 
we get a contradiction. 

Now let us assume that 1/ is a finite probability space with uniform distribution. We can represent 
undirected graphs on the vertex set V by their adjacency matrices G : V y. V ^ {{),!}. More 
generally assume that G:FxT^— >Risa symmetric matrix. The automorphism group Aut(G) is 
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the group of permutation matrices g satisfying gGg^^ = G. A matrix G : V x V ^ Wis called a 
step function with n-steps if there is a partition V = {Pi , P2 Pn} of V and an n by n matrix 
T : [n]^ R such that G(a, b) — T{i,j) whenevera e Pi and b e Pj. We say that G is abalanced 
step function with n steps if | |-Pi | — \Pj\\ < 1 for every i, j. 

Remark 1.1 Let G Q % be a convex. Loo-bounded closed set which is invariant under measure 
preserving maps on V. Then similar regularity lemma holds for every M in G such that S + E (z G. 
In particular ifC is the set of kernel operators taking values in [0, 1] then M is a graphon and so is 
S + E. The proof is essentially the same. 

Lemma 1.12 (Eigenvector clustering) Ife > and G ~ J2'i=i fifi^i ^^^^ ^^'^^ ll/j|loo < ™ and 

\\\ ^ mfor every 1 < i < k then there is a step function T with at most {2Qkm? /e)^ steps such 
that \\T - G||oo < £• 

Proof. Let us consider the partition V = U*^]^P,; according to the level sets of the function 

Here t < {2m/ ei)^ If two element vi,V2 € Pi and z«i,ii;2 € Pj then with a rough estimate 
|r(t;i, wi) — T{v2, W2)\ < lOfcm^ei. It follows that there is step function T with partition {Pi}l^i 
such that ||T — G||oo < lOfcm^ei. If ei < e/ (lOfcrn^) then T satisfies the condition of the lemma. 

Using the fact that in theorem|2]the matrix [M] \ is invariant under the automorphisms of G and 
the previous lemma we obtain the next version of the classical graph regularity lemma. 

Tlieorem 3 (Symmetry preserving regularity lemma) For an arbitrarily decreasing function i^(M+ , N) — >■ 

and e > there is constant n such that for every symmetric matrix G : V x V ^ there 
is decomposition G ^ S + E + R such that 

L S is a step function with s < n steps 

2. \\gSg^^ — 51100 < e for every g G Aut(G) 

^- \\Eh<e 

4. \\R\\n<F{e,s). 

At the cost of worsening the bound of n in terms of F and e we can also assume that T is a 
balanced step function. However in this case the Loo error in \\gSg^^ — '5'||oo < e becomes an L2 
error. 

1.6 Eigenspace convergence 

Let M be the set of kernel operators M : V x V ^ C with ||M|]oo < 1- 
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Proposition 1.1 Let {Mj}^^ sequence in Ai. Then the following two statements are equiva- 
lent. 

1. {Mi\^i is convergent in the cut norm 

2. there is a decreasing positive real sequence {ai\°°^i withYira^^ on = Q such that {[Mi\aj}°°^i 
is L2 convergent for every j. 

Furthermore in the second statement the cut norm limit M of {Mi}°^^ can be computed as 

M = lim (lim [M,]„.) 

converging in L2. 

Proof. To show that the first statement implies the second one let S be the set of eigenvalues 
of the cut norm limit M of {Mij^j^. Then by lemma [T. 1 II any sequence {a;} 00 avoiding the 
absolute values of the eigenvalues of M satisfies the convergence requirement second statement. 
The eigenvalues of M are forming a countable set and so we can choose satisfying the 

required conditions. 

Let = \iTCLi^^[Mi]a. and Dj = Lj+i - Lj. The functions Aj = [^^ila^+i - [Mi]a^ 
satisfy the following properties for every i 

1. DijDi k = for every i ^ k, 

2. (A,j,A,fe) = OinH®H*, 

3. the spectral radius of Dij is at most aj, 

4. E,°:illA,,|li-||M.|ll<i. 

This means that the sequence {Djjj^i satisfies the same properties. Using that last and the 
second property we have that J^JLi convergent in the L2 norm. Let us denote the limit by M. 
Our goal is to show that {Mi}^-^ converges to M in the cut norm. 

The first and third property implies that the spectral radius of Nj = J^'kLj is at most aj and 

so 

||M - M.lln < ||(Af - 7V,+i) - [M,]„Jb + ||M, - [Af.]„Jb + ||A^,+i|b < 

Now using the fact that [Afija^ converges to Lj we get that if i is big enough then || Af — Afi||n < 
3a j. Since {aj}°Zi converges to the proof is complete. 

Lemma 1.13 If {Mi}"^^ in M converges to M in the S\j distance then for every A > we have 
limsup,^^||[A/]A||2 < IIMII2. 
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Proof. We can choose a sequence of invertible measure preserving maps {V'ili^i such that 
{m/'}^]^ is convergent in the cut norm. By lemma [LTTI there is a value < a < A such that 

\\vai^^[Mi]a = [M]a\nL2. This means that limsup^^^ || [Afj]A||2 < limj^oo || [A^j]q||2 < 
IIM2II2. 

Proposition 1.2 Let {Mi}^-^ be a sequence in Ai. Then the following two statements are equiva- 
lent. 

1. {Mi}^]^ is convergent in the distance 

2. there is a decreasing positive real sequence {ai\°°^i with lim^^ on — Q such that { [A^^jo,^ 
is 5i convergent for every j. 

Furthermore in the second statement the cut norm limit M of {Mi\°^^ can be computed as 

M = lim (lim [M,]„J 

converging in 5i. 

Proof. To see that the first statement implies the second choose a sequence of invertible measure 
preserving transformations {V'ili^i such that {Mf''}^^ converges in the cut norm. Then proposi- 
tion [TTT] shows the second statement. 

We show that the second statement implies the first. Lj = limi^oo[Afi]c(j ■ Observe that 
by lemma [L6l \\Mi — [Mi]aj\\a < aj and so S^{Mi, [M^Ja^. ) < aj. If i is big enough that 
5a{Mi, Lj) < 2aj. This means that {Mi}°^-^ is a S\j Cauchy sequence which shows the first 
statement. It also shows that {Lj}J!Li converges to the cut norm limit M of {Mi}°^i in the 5n- 
distance. It remains to show that this convergence is also true in the Si metric. This follows from 
the fact that by lemma 11.131 1 1 i j 1 1 2 < 1 1 1 1 2 and so lemma 11.81 completes the proof. 

1.7 Regularization and group actions 

An advantage of the spectral regularity lemma is that it is invariant under the symmetries of kernel 
operators. To be more precise let G be a group of unitary operators onH ~ L2{V). Then there 
is a natural induced action of G on "H (81 "H* and in particular on the set of self adjoint Hilbert- 
Schmidt kernel operators. This action satisfies iJ"/" ^ {Hf)°' and (f°')*H°' = {f*H)°'. If 
H = J2i fifi^i is a spectral decomposition of H then — J^i ftUtT'^i- The next well known 
lemma is trivial from the previous remarks. 

Lemma 1.14 If a group G of unitary operators on L2{V) stabilizes a self adjoint Hilbert-Schmidt 

kernel operator H (H" = H for every a ^ G) then G stabilizes all the operators [H]\for A > 0. 
Furthermore the eigenspaces Wx- of H are G invariant spaces. In particular ran(i/ ) is G invariant. 
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A typical example for a kernel operator stabilized by a group action is a Cayley graphon. Let G 
be a compact Hausdorff topological group with normalized Haar measure /i. Let / be a Borel 
measurable function f : G ^ C Let M : G x G ^ C he the kernel operator defined by 
M{x, y) = f{x^^y). It is easy to see that the left action of G on itself induces a unitary group 
action of G on L2{G, /i) and it stabilizes M. If / has the property that f{g^^) = f{g) then the 
corresponding Cayley graphon is self adjoint. The next corollary of lemma[TTT4]creates a connection 
between quasi randomness and representation theory. 

Corollary 1.2 (Quasirandom action) If a group G of unitary operators on L2{V) stabilizes a self 
adjoint Hilbert- Schmidt operator H with 1 1 1 1 2 < 1 then the spectral radius ( and so the cut norm ) 
of H is at most 1 / \/d where d is the smallest dimension of a G invariant subspace in ran(i?). 

Proof. Lemma fl . 14l implies that every eigenvalue of H has multiplicity at least d. Since the sum of 
the squares of the eigenvalues is at most 1 we get that \^d < 1 is satisfied by every eigenvalue A. 

Corollary 1.3 (Quasirandom action II.) Let G be a compact Hausdorff topological group with 
normalized Haar measure /i. Let K C G be a closed subgroup and V be the left coset space 
{gK\g € G}. Let % = L2{V, fi) and d be the degree of the smallest non trivial representation of G 
which appears in the induced action of G on %. Then every G invariant self adjoint Hilbert-Schmidt 
kernel operator H with ||i?||2 < 1 satisfies \\H — p\\q < 1/^/d where p is the constant function on 
V X V with value ce — y H{x, y) dx dy. 

Proof. Let "H" denote the orthogonal space of the constant 1 function on V . The smallest finite 
dimensional G invariant subspace in THP has dimension at least d. It is easy to see that ran(iJ — p) C 
T-Lq. Then coroUarv U .2| finishes the proof. 

We demonstrate the usefulness of this simple fact on the next example. Let 5„ denote the 
n-dimensional sphere with the isometry invariant probability measure. We call a graphon W : 
Sn X Sn [0, 1] isometry invariant if W is invariant under the induced action of the orthogonal 
group 0,1+1 on Sn. Note that a graphon W is isometry invariant if and only if the value W{x, y) 
depends only on the distance of x and y. 

The next proposition says that on a very high dimensional sphere every isometry invariant 
graphon is very close to being quasirandom. 

Proposition 1.3 IfW is an isometry invariant graphon with edge density p on Sn then || W^— p|| □ < 
l/^A^TT. 

Proof. The smallest non trivial representation of the orthogonal group On+i which appears on 
L2{Sn) has dimension n + 1. Then corollarv ll.3l completes the proof. 
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1.8 Weakly random group actions 

Definition 1.3 Let G C U{L2{V)) be a unitary operator group. We denote byT{G, d) the set of G 
invariant self adjoint kernel operators with Loo norm at most d. 

Lemma 1.15 The set X(G, d) is closed under weak convergence. 

Proof. Let {Hi]°°^^ be a weakly convergent sequence of kernel operators in I(G', d) and let H 
be the weak limit. For every two functions f,gE L2{V) we have that g * 11°" f = lim g*H"f = 
lim g*HJ = g*Hf. This means that H" = H. 

We will need the following lemma about weak convergence. 

Lemma 1.16 Let C C L2{V) be a compact set and {Hi\°^^ be a sequence of kernel operators, 
with uniformly bounded L2 norms, weakly converging to the Q function. Then 

lim max ||5*-ffi/||2 = 0. 

Proof. Using compactness of C we can choose sequences {gi}°^i and {fi}°^i in C such that 
\\g*iHifi\\2 = max/^ggc ||5*-ffi/||2 = m^. Assume that rn = limsupj^^o^i > 0. Then by 
choosing a subsequence we can assume that m — lim^^oo 'm-i- Furthermore by compactness of 
G we can assume by choosing a subsequence that lim^-^oo fi = f and liuii^oo gt — g where the 
convergence is in the L2 norm. Now using the fact that the L2 norms of Hi are bounded we obtain 
that limi_>oo \\g* Hif\\2 = m > which is a contradiction. 

Definition 1.4 Let G be a group of unitary operators on L2{V). We say that G acts weakly random 
if for every natural number n the space Un generated by all G invariant subspaces in L2{V) of 
dimension at most n is finite dimensional. 

Next theorem shows a surprising graph theoretic aspect of weakly random group actions. 

Tlieorem 4 Let G be a weakly random operator group and let I{G,d) denote the set of self adjoint 
integral kernel operators M : V x V C that are invariant under G and have Loo norm at 
most d < 00. Then weak convergence on T{G, d) coincides with convergence in the cut norm. In 
particular I (G, d) is cut norm compact. 

Proof. Let {Hi}°^^ be a weakly convergent sequence in I{G, d). By subtracting (from every term) 
the weak limit H (which is also in I{G, d) by lemma [TTSl l we get a sequence in I{G, 2d) which 
converges to weakly. This means that without loss of generality we can assume that the weak limit 
of is the function. Let us choose an arbitrary real number e > 0. Let U be the space 

generated by all G invariant subspaces of dimension at most d^/e^ and let C/° be the unit ball in U . 
Using lemma [T7T41 we get that every normalized eigenvector of Hi corresponding to an eigenvalue 
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of absolute value bigger then e is in U'^. On the other hand, using the compactness of Uq and lemma 
I1.16l we get that there in an index j such that if i > j then maxyg[/o ||/*-ffi/||2 < e. This means 
that if i > j then the spectral radius of Hi is at most e and so ||i?i||n < e. 

1.9 Sphere vs. circle 

Let / : [—1, 1] ^ M be a bounded measurable function. We denote by S{n, f) the graphon defined 
on the unit spehere S'„ = {x\ x G ]R"+^, ||a;||2 ~ 1} with the uniform distribution such that 
w{x, y) — f{xy) where xy is the usual scalar product. 

The underlying topological space (in the sense of ifTSll ) of S{n, f) is either the sphere Sn or just 
one point if / is constant. In this part we point out that the case ?i = 1 is very different for n > 1. 
Let iS° denote the subset in S{n, /) where < f{x) < 1 for every — 1 < a; < 1. 

Proposition 1.4 Let n > 2. Then the set 5" is compact in the cut norm. 

Proof. For the first part let On+i be the orthogonal group acting on Sn- The induced action of 
On on L2{S„) is defined by /"(x) — /(x") where a G On+i- It is clear that spherical graphons 
of dimension n are invariant under this action. The representation theory of 0„+i on L2(5„) is a 
classical theory. It acts weakly randomly which proves the first part. 

Corollary 1.4 Let n > 2. Then the set S'^ is closed in S\j and so it is characterizable by inequalities 
in subgraph densities . 

Proof. If {Mi]°°^^ in 5° is convergent then we can choose a weakly convergent subsequence. 
By proposition 11.41 this subsequence is cot norm convergent. The limit M is in 5° and it has to 
coincide with the 5^ limit of {Mi}°^^. 

Proposition 1.5 7/"n = 1 then the set is not compact in the cut norm. 

Proof. Let us define the graphon W on the circle 5*1 by W{x, y) — lif xy > Q and W{x^ y) — 
if xy < 0. Let us represent Si and the abelian group A = M/Z. It is easy to see an well known 
that for every fixed k the map ipk ■ a i-^ ka is a measure preserving map on A. This means that 
S[j{W'^'' , W) — for every k. We show that the sequence does not have a cut norm 

convergent sub sequence. Assume by contradiction the {W^''i is convergent in the cut norm. 
Then the limit L has Sa distance form W and thus ||i||2 = ||1^||2- By lemma [TTS] this means that 
{W'^'^i is convergent in L2- It is easy to see that this is not the case. 

Without proof we mention that the set 5° is not even closed in S^. There are examples where a 
sequence of graphons in 5° converges to a graphon whose underlying topological space is the torus. 
Such a graphon can't be represented on the circle. 

Motivated by the above results it is natural to introduce the following notion. 
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Definition 1.5 Let (V, /i) be a probability space with a-algebra A and measure fi. Let B C 
Ay~ Abe a sub a-algebra on the product space V V. We call B weakly random if in the set of 
functions {M\M € Loo{B), ||Af||oo < 1} weak convergence implies cut norm convergence. 

Proposition ! 1 .4l savs that if V is the sphere 5*2 and B consists of those Borel measurable sets that 
are invariant under the diagonal action of O3 on 1/ x 1/ then B is weakly random. 

Question 1 Is there any characterization of weakly random a-algebras? 

Another interesting topic is to understand when {M\M e Loo{B), ||Af||oo < l}is closed in the 
6a metric. Weakly randomness impUes this but the other direction is not true. 

Balazs Szegedy University of Toronto, Department of Mathematics, St George St. 40, Toronto, ON, 
M5R 2E4, Canada 
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